1 



(12) INTERNATIONAL JffLlCATION PUBLISHED UNDER THE RATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) Intemational Publication Date 
29 November:2001 (29.11.2001) 




PCX 



(10) International Publication Number 

wo 01/89373 A2 



(51) International Patent Classification^: 



A61B:3/00 



(21) International Application Number: PCT/EPOl/05838 

(22) International Filing Date: 21 May 2001 (21.05.2001) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 
60/206,091 



20 May.2000 (20.05.2000) US 



(71) Applicant (for all designated States except US): SEN- 
SOMOTORIC INSTRUMENTS GMBH [DE/DE]; 
Warthestrasse 21, 14513 Teltow (DE), 

(72) Inventors;:and 

(7^ Inventors/Applicants (for US only): TAYLOR, Natalie 
[DE/DE]; Warthestrasse 21, 14513 Teltow (DE). LUTZ, 
Peter [DE/DE]; Warthestrasse 21, 14513 Teltow (DE). 
SCHMIDT, Eberhard [DE/DE]; Warthestrasse 21, 14513 
Teltow (DE). TEIWES, Winfried [DE/DE]; Warthes- 
Uasse 21. 14513 Teltow (DE). WEISE, Ralf [DE/DE); 
Waithestrasse:21» 14513 Teltow (DE). 



(74) Agent: DdRRIES, FRANK-MOLNIA & POHLMAN; 

Postfech 221661. 80506 Munich (DE). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU. CZ. 
DE, DK, DM, DZ, EE, ES, FI, GB, GD, GE, GH. GM, HR, 
HU, ID. IL, nsr, IS, JP, KE. KG. KP. KR, KZ. LC, LK. LR, 
LS. LT, LU, LV. MA, MD. MG, MK. MN, MW, MX, MZ. 
NO, NZ. PL. FT, RO, RU, SD, SE, SG, SI. SK. SL, TJ. TM, 
TR. TT. TZ, UA. UG, US. UZ, VN. YU. ZA. ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ. SD. SL. SZ. TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, H, PR. GB, GR, IE, 
IT, LU. MC, NL. PT, SE, TR), OAPI patent (BF. BJ, CF, 
CG, CI. CM, GA, GN. GW. ML, MR, NE. SN, TD, TG). 

Published: 

— 'Without international search report .and to be republished 
atpon receipt of that report 

For two-letter codes and other abbreviations, refer to the **Guid' 
ance Notes on Codes and Abbreviations " of^aring at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: METHOD AND APPARATUS FOR A CONTROLLED CUSTOMISATION OF THE CORNEA 



(57) Abstract: The present invention covers a method and apparatus to measure the position of an eye in up to 6 degrees of j&reedom, 
^ the pupil diameter and the identity of an eye in dififerent diagnosis and treatment instruments and to link and relate the di£feient 
QQ positions measured at different times and/ or in different instruments to each other. The method used for linking and relating the 
^ position measurements to each other is a co-ordinate transformation between the diiBferent system co-ordinate systems and the eye 
^ co-ordinate system as measured by image processing or other measurement techniques to obtain either single or combined measures 

of degrees of freedom. In addition to the position of the eye, the identity of the eye under diagnosis or treatment can be measured 
W and recognized in the different instruments and systems. The measurement of the eye position and pupil diameter can also be done 
^ with dififerent measurement techniques like standard or non-standard video image analysis from one or several cameras per system, 

optical coherence tomography, laser interferometry or others. 
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TITLE ^ 

Method .and:apparatus for a . controlled customisation of the cornea 
Background of :the Invention 

The present ±iventioii :is directed to improve methods of ophthahnic diagnostics and / or 
ophthaknic ireatmmt processes and apparatuses iiaplementing such methods. The technique 
.according :to the present invention improves the .accuracy of diagnosis^ comparing or 
synthesising diagnoses :from different devices and/or for performing treatments or corrections 
based on "these diagnoses. The .applications relevant to the present invention :inchide 
Tefractive surgery of :the cornea, OPRK, LASIK or LTK^ insertion of prosthetic devices such 
.as intraocular Ileuses (lOLs) or xetuial .chips .and other corrective surgery such as retinal 
surgery or .glaucoma surgery. 

pphflialxmc diagnostics nrequixeiihat the optical, spatial, visual or physical diaracteristics are 
determined. Visual or refractive performance is measured with auto-refractors, perimeters, 
corneal topographers or more recently with wave fiont aberronpLetry tedbnigues providing 
information also of higher orders of aberrations of the eye (two dimensional optical 
characteristics). Topometry / topography systems provide a 2 dimensional elevation map of 
the shape of the cornea, which has a major influence on the refractive performance of the eye. 
Spatial characteristics include corneal pachymetry, lens thickness or position, anterior 
chamber depth, axial length and retinal thickneiss. The characteristics may be measured with 
ultrasound, optical coherence tomography, confocal microscopy, video image processing or 
other optical techniques. Physical characteristics include optical disk size, blood vessel 
density or features on the retina such as cotton wool spots and these may be measured using a 
camera, microscope or ophthalmoscope and image processing techniques. For one patient, a 
variety of instruments may be used to measure difierent characteristics of the eye, and each of 
the measurements will be done at different periods of time. A comparison or synthesis of 
these measurements may be needed to make a diagnosis and the spatial registration may be 
critical to the overall accuracy. 

The treatment that arises from the diagnosis may also be spatially dependent, wherein the 
efficacy of the treatment dep^ds on where it is placed on the eye. Therefore, the treatment 
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must also be registered on the patient's eye. For example, the positioning of an ablation 
profile for laser vision correction or laser thermal keratoplasty (LTK), the positioning of an 
intra-ocular lens (lOL) for refiractive correction or other prosthetic device such as retinal 
implant or artificial cornea, or the positioning of a laser beam for vitrectomy, retinal 
reattachment or other retinal surgery or for glaucoma surgery. The treatment may be 
performed using a surgical instrument difiGarent to the diagnostic instrument such .as a 
refiractive laser device^ microscope, vitrectomy system or other laser delivery system. 

The two :most common ^plications whwe the present invention coiild be applied are laser 
xefi-acdive surgeo^.and :intra-K)cular lens implantation. 

;With the refiractive laser surgery tedmique,A^ shape of the comea is altered in a way that the 
optical .deficioicies of the whole eye are cornpensated. Using a x-y scanner to control the 
position of the laser contact point on the eye or cornea, complex ablation profiles can be 
apphed to correct for non-spherical optical characteristics (i.e. astigmatism), higher order of 
aberrations or even perform prismatic corrections on both eyes to adjust vergence / strabism. 

As shown in figure 1, with a pre-surgery diagnosis fiie actual shape of the cornea and its 
optical characteristics are determined. Using modelling (comparing actual and ideal corneal 
surface) and knowledge about the laser ablation process an individual customized ablation 
profile can be computed to improve overall vision. During treatment corneal tissue is ablated 
with a multitude of laser shots according to the ablation profile in order to shape the cornea to 
its ideal profile. Xhie to the patient's eye movements during the surgery procedure, eye 
trackers are commonly used for measurement of the actual eye position and with the use of a 
positioning device, for example a x-y-scanner for the laser, these eye movements are 
compensated by correcting the ablation position with the changed eye position. In the fiiture, 
even online monitoring such as registration of actual laser ablation positions on the eye or 
online changes of the elevation (Online — Topography) may be used. After laser treatment the 
corrected comeal shape may be re-exauMned with the same or other diagnostic techniques as 
before treatment. 

An alternative technique for correcting refiractive errors, is the insertion of intra-ocular lenses. 
The present invention can improve the rotational orientation, tilt and centration of the 
placement of an artificial lens placed inside the eye. These artificial intra-ocular lenses 
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(lOLs) are used to either replace the phakic lens in cataract surgery, or to correct refractive 
errors. 

The technique for correcting refractive errors is to implant an artificial lens with a particular 
form and refractive power to conopensate for the .measured refractive error of the eye either in 
front of tile l&ns or iris. The operation is completely reversible.and leaves the central area of 
the comea intact — two strong advantages over laser refractive surgery. 

While theinajority of lOL procedures -areperformed to correct !hig^inyopia,.astigrnatic:intrar 
ocular lenses are also available. These lenses are asynmietric -and "therefore, the rotational 
.alignment is important :for .the optimal correction of .astigmatism. .As with laser refractive 
surgery, the first step.is to measure the refiraction spherical error, cylinder .and astigmatic axis 
using an ophthalmic diagnostic device, such as phoropter, comeal topographer, spatial 
refractor or aberrometer. A suitable lens :for the refractive error can either be selected as an 
off-the-shelf component or manufactured individually for thepatient 

Intraocular lenses are also used in the treatment of cataracts. When the lens becomes 
opacified, it must be removed .and replaced with an .artificial lens. Approximately 20% of 
cataract patients have pre-existing .astigmatism that could be treated .iising .an as3^rQmetric or 
toriclCTS. 

Intraocular lens surgery may be combined with .laser refractive surgery to make small 
adjustments to the refractive correction. 

The presMt techniques are linuted in accuracy. In a study of 37 eyes, almost 20% of lOLs 
were rotationally misaligned by 25** (cf. Riihswunn, Irene. Scholz, Ursula. Zehetmayer, 
Martin. Et al. "Astigmatism correction with a foldable toric intraocular lens in cataract 
patients" J Cataract Refract Surg. 2000;26:1022-1027). This rotation alignment can be made 
simpler and more reliable by the present invention. 

The present art of ophthalmic diagnosis and treatment has some deficiencies, thus limiting the 
overall accuracy and reliabiUty of the whole process: 
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1 . For each step in the process from pre-surgery diagnosis over treatment to post-surgery 
diagnosis with sometimes multiple diagnostic and treatmait techniques involved in 
each step, an adjustment -procedure has to be performed, genially xeferred to as 
centration, with the purpose of aligning the patient's eye to the diagnostic or treatment 
device. This device dependent centration procedure is often based on the human 
judgement of the surgeon or technician performing :the. alignment with little objective 
guidance or control, Tesiilting in poor Tcpeatability and ^accuracy of measurements, 
inaccurate treatment computation and inaccurate positioning of flie treatment or lens 
on the eye. 

-2. Centration ecrors become even more problematic when eycTelated datairom different 
devices (for example corneal thickness measurement itogether with topography) are 
compared, since here these eiTors sum tqj/Eurtherm centration often is based on the 
prq)il centre evaa though it is known that pixpH diameter changes have an effect on fhe 
position of the pupil centre with respect to the optical axis. 

3. Since the treatment changes the characteristics of the eye such as refiraction, any 
centration procedure based on an optical reference axis or the optical system.might be 
biased^Tesulting in alack of comparability between pre- and post-surgery diagnosis. 

4. If a surgical system does include some form of eye .tracking, such as laser ablation 
systems, only a two-dimensional eye tracking during treatment is used/ while .the eye 
is kept within a constant distance to the.laser source. However, the eye has in principle 
6 degrees of freedom (three translational and three rotational). 

5. Slight head movements may also result in a different distance of the eye to the device. 
This is especially problematic for laser delivery systems, which are focussed with their 
energy constant only over a limited range. Changes in distance therefore result in 
changed energy on the eye and therefore uncontrolled surgical effect. 

6. The eye also performs eye movements about the line of sight - torsional eye 
movements (vestibular ocular reflex) and the head position in roll may be different 
when the patient is supine under the one device and sitting up at another device. This 
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results in inaccurate positioning of diagnosis or treatment which may not be 
rotationally symmetric. 

7. Furthermore, sometimes the left eye noiay be treated with the prescription and 
treatment for ablation profile calculated for a different patient This unsafe handling of 
data andimissing objective control results in severe mistreabnent.and possible damage 
of thepatienl's eye. 

Summary of ihe Invention 

The overall objective of the present invention is to provide a common, eye based reference 
system for ophthalmic diagnosis and .treatment to :increase reliability and accuracy as well as 
to enable an improvement of ihe overall ^irocess and outcome of ophthalmic diagnosis and 
. ireatment A ifiirther objective is to improve:the:registration of dififerent diagnostic techniques, 
where a combination of measuremeuts is needed to diagnose the eye. A further objective of 
flie invention is to provide the basis for aligning or placing individual, non-spherical refractive 
corrections of high quality to allow correction for astigmatism, higher order Serrations etc. A 
further objective :is to allow the accurate placement of other ophthalmic surgeries such as 
retinal treatments or inserting corrective prosthetic devices such as lOLs. Still a furflier 
objective of the invention is to increase security of the treatment by ensuring identity of the 
eyes during different diagnostic and treatment steps. 

These goals are achieved by comparison of eye position measurements performed during each 
diagnosis and/or treatment and then linking the eye related data (such as elevation, abenrations 
and ablations profiles or lens position) to a common eye fixed refer^ce system. Figures 1 
shows the process by which the different coordinate systems are linked. 

Co-ordinate transformations for data obtained originally in device coordinate systems into the 
common eye co-ordinate system are supplied, thus ensuring best possible comparability, 
reliability and precision. By the integration of eye torsion into the common eye coordinates it 
is guaranteed, that even non-rotationally-synmietric corrections or prosthetic devices can be 
placed relative to the eye. 

Furthermore, the eye is analysed using pattern recognition techniques, such as iris recognition, 
in order to provide identification of the eye with each measurement Before apphcation of any 
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treatment, this identification is perfonned to secure that the correct patient and correct eye is 
treated. 

A preferred embodiment for the determinations of eye position and orientation coordinates by 
using .a :multi camera system in combination with torsional measurements and eye 
identification .using iris recognition is proposed. 

The objectives of the present invention are.achieved by providing tiie doctor with an objective 
measurement ofibe.eyeposition relative to the device and orientation ofibe lensrelative to an 
eye^based coordinate system. These positions are calculated in an eye-based coordinate 
system, based on .the reference image taken in the diagnostic process. 

An image ofihe eye during the diagnostic:measurement is .saved to axaemory device, and . fiie 
characteristics of the eye suchias but^iot limited to aberration map, .topography, astigmatism 
axis, retinal thickness, optical disk depth, blood vessel density etc. relative to this eye based 
coordinate system are recorded. 

The present invention also makes a quality check of the reference image, to ensure that it can 
be used .as .a basis for position coxnpaiison .at later steps. This check ensures that the features 
required to :fix the coordinate system, or to compare the image with a second image to find a 
relative transformation, are present in the image. 

At subsequent instruments or subsequent diagnosis or treatment, images of the eye can be 
captured and using image-processing techniques, the position of the eye relative to the eye 
during the first diagnostic measurement (the original eye-based coordinate system) can be 
calculated. This displacement can be done in anything up to 6 dimensions (cf. Blander, R., 
Rich, L.F., Robin, J.B.: "Principles and Practice of Refiractive Surgery"; WJB. Saunders 
Company, Philadelphia; 1"* ed.,1997), but in the preferred embodiment at least x, y and 
torsion around the visual axis. In procedures, where the pupil is a natural size or constricted, 
natumlly occurring iris landmarks can be used to calculate the torsion of the eye around the 
visual axis. If the eye is dilated and the iris is no longer sufficiently visible, artificial 
landmarks or markers can be used to calculate the ocular torsion and / or translation. In this 
way, a transformation is found between the coordinate system of the eye during surgery and 
the coordinate system of the eye during diagnostics is foimd. 
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The invention can also return a cx)nfidence level based on the level of correspondence 
between the reference image and measurement image. This indicates the accuracy of the 
calcxilated transformation. Once the transformation has been calculated, either the diagnostic 
data or treatment data is transformed to ensure a constant coordinate system. 

For the embodiment of the invention for lOL surgery/ the position of the lens relative to the 
eye based coordinate system can be also calculated from the surgical image. For example, 
using the alignment marks on the rim of the optics or the footplates or haptics of the lOLs, the 
rotational alignment of the lens can be calculated relative to the eye based coordinate system, 
and hence the astigmatic axis of the eye. Tilt could .also be calculated by measuring :the 
distance between these alignment marks or tbe distortion of tiieimage of .the lens relative to 
the camera. The centration.could^lso1>e calculated Iro 
processing of the lens. 

The image of the eye during surgery can then be displayed to the doctor, for example on a 
computer monitor, with the actual position of the lens and desired position of the lens 
overlaid. This provides the feedback to the doctor, who can then adjust the location of the 
lens towards the desired orientation. The measurement is then repeated to ensure the position 
is correct JBlse the lens is readjusted andlhe measurement repeated etc. 

For the embodiment of retinafl surgery, the invention nciay a^ givefhe position on the eye at 
which the laser beam is aimed as feedback to the clinician. 

SHORT DESCRIPTION OF THE DRAWINGS 

Fig. 1) state of the art processing scheme 

Fig- 2) general processing scheme for determination of coordinate transformation from image 
transformation 

Fig. 3) schematic transformation paths 
Fig. 4) schematic three camera system 
Fig. 5) embedding of schematic eye in coordinate system 

Detailed Description 

To overcome the problems mentioned above, this invention provides a cormnon eye-fixed 
coordinate system and the methods to localize this reference system by detenniiiation of all 
six degrees of freedom of the eye during each pre-/post diagnostic measurement and laser 
treatment 
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As shown in fig. 5, the origin of the eye-fixed co-ordinate system (preferably Cartesian) E is 
placed into the centre of the eye. Here the xe-ye-plane lies perpendicular to the optical axis of 
the eye, which itself is aligned with the ze- axis of the eye £xed coordinate system. Whereas 
ze-axis and origin are well defined, the orientation of the :xe--and;ye-axis withing the xe-ye 
plane must still be jBxed to the eye. This fixation is done by acquiring an image of the eye to 
document the eyeposition with respect to the device fibcedTefereace system. It is appropriate 
to define the torsion to be equal to zero to the eye position as acquired in the reference im^ 

This eye fixed refeiience system is embedded in the :3-dimeasional device/system :fixed 
reference system (right-handed Cartesian co-ordinate system) by the position vectorX=(x:y :z) 
that determines eye translation and by Enler's angles PHI, THETA and PSI, that determine 
eye rotations with respect to the device/system fixed reference system. H^e PSI can be 
identified with the torsion angle of the eye. PHI and THETA determine the inclination angles 
of the eye. 

With respect to the application in diagnostic or treatment procedmre, importance of the eye 
coordinates differs. Generally, the most important coordinates, however, are the translational 
coordinates x, y, z, determioing the resulting angles imder which the centre of the pupil or 
limbns or fimdus occur relative to the optical axis of the camera as well .as the distance firom 
eye to the observing device. The angle PSI of the torsional rotation of the eye about its optical 
axis can also vary significantly between measurements and treatments due to eye and. head 
movements and diffarent positions of the head relative to the instrument(s). The inclination 
angles PHI and THETA are of minor importance, since they .are usually held approximately 
constant by asking the patient to fixate a marker and to avoid head movements. Nevertheless, 
for increase accuracy, these angles should also be included. 

Linkage between diagnosis and treatment/ co-ordinate transformation 

During diagnosis or treatment it is appropriate to address any point P on the eye in a 3- 

dimmsional device/system fixed coordinate system REF wititi the coordinates R = (x y z). 
These coordinates do not refer to the same point on the eye anymore, if tiie eye moved 
relative to the space-bound reference system. This also holds, if different devices are 
involved. In this case, the difference between the eye positions relative to flie coordinate 
systems of those devices can be interpreted as an eye movement relative to the same 
coordinate system. Now, this point P is addressed by the new coordinates R' = (x* y' z')> 
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depending on the position and orientation of the eye before and after the movemrat. In eye 
fibced reference system the equivalent coordinates of point P are constant and given by the 
vector e =(xe ye ze). As .shown in fig. 4, the linkage between the two reference systems is 
given by the two coordinate itransformations 

e =A'^(R-X).andll = Ae + X 
if X = (x y z) is the position vector for the origm of the eye fixed Teference system and PHI, 
THETA:and PSIithe underlyingTOtation angles of :the:eye. A^ is the transposed matrix of the 
rotation matrix A, which is given by its elements Afj/with 

Aii= cos PHI cos PSI— siaTHI cos THETA sin PSI 

Ai2=-cos Pm SIN PSI - sin PHI cos THETA cos PSI 

.Ai3 = smPHI SDSr THETA 

A2r= sin PHI cos PSH- cos PHI cos THETA sin PSI 
A22=-sin Pm sin PSI + cos PHI cos THETA cos PSI 
A23 =-cos:PHI sin THETA 

A31 = sin THETA sin PSI 
A32 = sin THETA cos PSI 
A33 = cos THETA. 

Ttierefore, these transformations provide the linkage between eye related data and the eye 
position for exchange: leye related data at any point P, addressed for example in a diagnostic 
device by its position vector R (in system/device fixed coordinates) is addressed by the 
equivalent position vector e in eye fixed coordinates. The transformation paths are shown ia 
Figure 3. 

In order to provide a linkage between difG^ent system/device fixed refarmce systems a 
combination of the above transformations is used to set xsp the transformations T and TINV. T 
and TINV map the position vectors R and R' of different device fixed coordinate systems of 
the same point on the eye onto each other, as shown in fig. 4, T and TINV can be calculated 
using the indirect way over the eye fixed coordinates e. The device fixed (Sj^em APP) 
position vector R% due to eye position x\ y\ z' and eye orientations PHI', THETA' and PSI' 
is linked to its position vector R (in system REF) with eye position x,y,z and eye orientations 
PHI, THETA and PSI by the transformations 
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T: = A'e 4- X' - A'A'^(R-X) -h and 
TINV: R = Ae +.X = A(AO^ (R'-X^+X 

.Here all prime variables refer to second System APP, but are defined as above. For generality, 
APP and REF do.iiot .have to be dijSerent devices: This invention is .also applicable to one 
device with APP.and REFTeferxingto different eye positions:in thesame device at subsequent 
'times or eye positions-relative to different camera positions in amore camera system. 

As.above,.eyeTelated.data:at anypointP on the eye is. addressed in different. systemsKEF and 
APP by the equivalent position vectors R -and R*. Therefore theiransformations T and TINV 
provide the ability to exchange eye related data between different devices or eye positions, 
Tespectively. The important.advantage offhe eye fixedreference system is that any eye related 
data.given in this system does not rely on the eye position and orientation. 

The use of the above mentioned coordiiiate traiisformation requires a localization of the eye 
fixed reference system. Therefore -the eye . coordinates :iQ system/device fixed reference system 
have to be detemuned in order to set up the vectors needed for transformation. If one takes 
care that any subset of the coordinates remain constant^ these transformation will only liave to 
be.applied to theTemaining subset of coordinates. :Fig. .2 shows apossible processing path for 
localisation of the eye based co-ordinate system by image transformations. 

.Localization of the eye-bound reference system 

In order to localize the eye fixed reference system, the eye position has to be determined for 
all six degrees of freedom. For localization of the eye fixed reference system in a sp£ice- or 
device-bound reference system, different techniques can be combined: 

In the preferred embodiment of the invention a triangulation procedure is used in order to 
determine the translational coordinates of the eye in the space-bound reference system. 

Any triangulation procedure, using more than one camera, can detmnine the exact position of 
the eye in three dimensions without the need to perform advanced image evaluation due to 
geometric distortions etc. Here, all cameras measure individiial optical angles, i,e. horizontal 
and vertical angles between optical axis of the camera and the visual axis under which a 
pronunent spatial characteristic on of the eye occurs. If all camera positions and orientations 
are known, the spatial coordinates of this prominent spatial characteristic are given by the 
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intersection of the visual axes of the cameras. For triangulation only two cameras are 
necessary, as the intersection is already possible for two visual axes. Due to imperfect 
adjustment of the cameras, a calculation of the intearsection point of the visual axes migjit fail, 
although the visual axes should intersect In this case no conclusions can be drawn about the 
correct camera positions. With .a triangulation using more than two cameras, the camera 
positions and orientations need .not be known with great accuracy, because this additional 
information eaiables a coxrection of the camerapositioiis. 

In the preferred embodiment, the ,eye*s translational coordinates are measured with a 
triangulation procedure using up to three cameras for eye traddng as shown in fig. 5. One 
camera (Camera 1) . is positioned in :fiont of the eye in :flie optical axis of the eye. The otiiers 
(Camera ! and 3) are positioned to the left and right of . the eye, viewing the eye from below 
the line of sight. Thus the camera positions form airiangle in front of the eye, with the optical 
axis intersection preferably at the centre of the eye. Here, the cameras measure the visual 
angles, i.e. the horizontal and vertical angles between the optical axis of each camera and the 
visual axis, i.e. the direction under which -the origin of the eye fixed reference system occurs. 
The intersection point of these visual axes is identical with the origin of the eye fixed 
reference system and therefore the eye's translational coordinates can be calculated, if all 
positions and orientations of the cameras are known. 

With at least three cameras used for triangulation, a detection of misaligmnent of the cameras 
is possible. This is not the case for a two-camera system, where a precise determination of the 
eye's translational cooidinates is only possible, if tiie exact camera positions are known. With 
the preferred system all six coordinates of the eye could be measured by triangulation of three 
different points on the eye, e.g. with two fiarther so-called landmarks that can be recognized 
easily. 

With only one pronodnent point or fixed spatial landmark imder observation, the coordinates x, 
y, z in the space-boxmd reference system can be determined. 

In anoflier embodiment, only one camera is used for calculating x and y translational 
coordmates, wherein a fixed landmark on the eye such as pupil centre, limbus centre, fundus 
or oth^ retinal landmarks can be used to locate the eye. When only one camera is used for 
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calculating x and y, further dimensions such as z may be found using a second measuremait 
tedmique; such as optical coherence tomography, interferometeiy or ultrasound. 

In . another embodiment IR-diodes are used to measure x and y based on the limbus border and 
a camera is .used to measure the rotation around the visual axis. The olher iotatioiis are not 
considered. Siniilarly .another embodiment uses a pattern projection onto the cornea and two 
cameras to measure^,y.aiid.z position andTotations of tiiispattem PHI and THETA/Rotation 
around the 2 axis is measured using an IR diode array measuring the :movement based on 
:maikers. This fiUustrates the breadth of implementation options :fi>r this invention which can 
be based on large^umber of combinations of jneasuremrait techniques to cover the di£ferent 
degrees of .freedom. 

Jn ordertoallownon-rotation-symm^c treatment of the cornea, torsion has to be determined 
by comparing the current image witii the.image acquired for definition of the referCTice. In flje 
prefened embodimeut, eye torsion is measured using a cross-correlation iechnique. Lnages 
acquired by Camera 1 are compared with the image acquired for definition of the eye fixed 
reference system. Here, the greyscale values of an iris segment are cross-correlated with the 
corresponding segment of the reference iris image (cf A.H. aarkes, W. Teiwes, .and H. 
Scherer. Video-Oculography - An Alternative Method For Measurement Of Hiree 
Dimensional Eye Movements. In: Oculomotor Control and Cognitive Processes, eds. R- 
Schmid and D. Zambarbieri. North Holland: Elsevio: Scioice Ptiblishers, 1 99 Lpp. 431-443). 
A maximum of the resulting cross-coirelation function indicates amatdung of the underlying 
greyscale profiles, i.e. an equal torsion angle. The torsion angle is then detemiined from the 
abscissa of the maximum. 

In another embodiment, temporary or artificial landmarks such as ink, flureads, LASK. flaps, 
visual patterns generated by the laser during surgery like the shot pattern of a femto-second 
laser within flie stroma or suction rings may be uised to calculate torsion or x and y between 
two measurement or treatment devices. The position of two or more of these landmarics is 
tised to calculate the rotation, PSI. 

In another embodiment rotation, PSI can be found by cross-correlation of the fimdus image or 
finding several landmarks on the retina to locate the eye. " 
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The remaining degrees of freedom PHI and THETA are determined by measurement of the 
geometric distortions of the pnpil/Iimbus border according to the camera position. As three 
cameras measure these distortions with known angles between their visual axes, size ,and 
shape of the pupiMimbus can be compensated. Geometric distortions :are small, if the camera 
is placed close to the visual axis of the:eye as the camera observes only .the projection of the 
pupil/timbus. Therefore the above described three camera system provides .the :possibil2ty to 
.measure distortions with the camera imder .the best angle. 

In the preferred embodiment, the reference image, .used to define .the O^torsion angle, is also 
used for comparison with an image of the eye acquired in a difiiarait device or:a different step 
of the diagnosis and treatment process. .An iris recognition procedure or security check is 
applied to check, whether 'the eyes in those images are identical, i.e. belong .to .the same 
person and refer to the same side of the patient (OD/OS). 

In the preferred embodiment patient's identity data, the reference image (or several images or 
measurement data sets depending on the techniques employed) for definition of the eye fixed 
reference systraa and the diagnostic or treatment data in eye fixed coordinates are stored 
together in electronic form. This combination provides the possibility to take fidl advantage of 
the invention, because a linkage to the reference eye fixed coordinate system is reached by the 
coordinate transformations at any st^ in the diagnosis/ treatment chain. This also holds for 
the security check or patient eye recognition check. Therefore any two eye related data sets 
can safely and reliably be compared with each other. 

In the preferred embodiment, the reference images undergo a quality check, in which the 
spatially fixed landmarks are checked to ensure that the image is suitable for further 
processing ie. Each image at each stage of the process is checked to ensure sufficient quahty 
and features are present on which to base the coordinate system and calculate a 
transformation. 

In the preferred embodiment, the calculation of the correlation performed to find the 
transformation between eye locations will also return a confidence value. This value gives the 
level of correlation and reUabUity of the coordinate transformation. 
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The present invention outputs the required coordinate transformation and either transforms the 
diagnostic data or treatment, so that the subsequent diagnostic measurement or surg^y is 
registered to the fbrst. 

In die preferred embodiment, a visual comparison check is made of the eye registration, 
wh^ein an overlay is used as .a marker to facilitate :the clinidan visually checking the 
registration against obvious landmarks. 

It is important to mention .that the coordinate itransformation is applicable to any subset of 
coordinates, if one tak» care, tiiat thexemaming coordinates .are .constant in both systems. For 
exanaple, if the patient jBxates a mark, thus eiisuring constant inclination angles of the cornea 
-in both devices, then it is sufficient to apply the abovemethods to the subset of coordinates x, 
y, z, psi. In this case an accurate laser .treatment of mon-spherical eye deficiencies (e.g. 
astigmatism) is already possible. 

There exist many more techniques for measuTCTient of the eye co-ordinates, which could be 
included into this invention: 

• Conventional eye tracking based on pupil, outer iris boarder / limbus, or corneal 
reflectionsCPurkinje): x, y 

• Fringe pattern projection and stereoscopic image processing: x, y,-z, PHI, THETA. 

• IR diode based limbus or marker tracking: x, y or x, y and z. 

• Interferometric measurement: z 

• running time of ultrasonic wave: z 

• confocal measurement: z 

• Cross-correlation, neuronal networks, landmark search, iris recognition, fundus tracking: 
torsion 

• head tracking, slit-lamp, fundus tracking: inclination angles 

• geometric distortions, scaling: all coordinates 



14 



BNSDCXSID: <WO_0180373A2„I_> 



wo 01/89373 




PCT/EPO 1/05838 



Claims 

We claim: 

1. A semi automatic or .automatic method for objectively :measuring ocular alignment 
consistently across and witbin more than one ophthalmic device by performing a 
coniparison process including: 

a. identifying the eye and location of the eye at each device relative to a device- 
dependent coordinate system; 

b. .using .spatially defined charactecistics of ihe eye lo fe: the location of a 
coordinate system relative to the eye to obtain an eye dependent coordinate 
system; 

c. using the eye dependent coordinate system :to calculate a coordinate 
transformation ^between device-dependent coordinate .systems and the eye 
dependent coordinate system. 

The method of claim 1, furtiher characterized in that the spatially defined 
characteristics of the eye are fixed naturally occurring landmarks such as the limbus or 
those naturally occurring in the iris structure, sclera or retina. 

3. The method of claim 1, fiirther characterized in that the spatially defined 
characteristics of the eye are temporarily .applied :inaikers or landmarks, or features 
created during the diagnostic or treatment process such as the LASIK flap or flap 
cover in LASIK refractive surgery. 

4. The method of claim 1, further characterized in thait the spatially defined 
characteristics of the eye are any combination of fixed naturally occurring landmarks 
and temporarily applied markers or landmarks, or features created during the surgical 
process, diagnostic or treatment process, which are located relative to the fixed 
naturally occurring landmarks. 

5. The method of claim 1, characterized in that the eye dependent coordinate system and 
the device-dependent coordinate systems comprise up to 6 spatial degrees of freedom 
and the pupil diameter. 

6. The method of claim 1^ characterized in that a transformation is determined between 
one eye-dependent coordinate system and a second eye-dependent coordinate system 
or eye-dependent alignment axis, such as the visual axis, line of sight or any other 
alignment axis. 
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7. The method of claim 1, characterized in that one or more ophthahmc devices may use 
one or a combination of measurement techniques to obtain a measurement for one or 
more degrees of freedom. 

8. The method of claim 1 , characterized in that the more than one ophlhahnic devices can 
be any conibination of ophfhahnic devices such as diagnostic and surgical or only 
diagnostic. 

9. The method of claim 1, characterized in that . theonethod is used for the q>plication of 
identification ofihe eye (which.eye ofwhom Im) and recognition of the eye (is this 
the correct .eye 1 : 1) eifh^ stand-alone orin conibination with the coordinate transfomi 
and leference system. 

.10. -Themethod of claim 1, characterized in that the method is used for a technique for the 
visual comparison of the eye registration, wherein an overlay can he used as a marker 
to check the registration against visuallandmarks. 

11. An :apparatus for objectively measuring ocular ahgoment consistently across and 
within more than one ophthalmic device by performing a comparison process 
including: 

a. means for identi^dng the eye and location of the eye at each device relative to 
a device-dependent coordinate system; 

b. means for using spatially defimed characteristics of the eye to fix the location 
of a coordinate system Telative to the eye to obtain an eye dependent 
coordinate system; 

c. means for using the eye dependent coordinate system to calculate a coordinate 
transformation between device-dependent coordinate systems and the eye 
dependent coordinate system. 

12. The apparatus of claim 1 1, fiirther including means for automatically locating suitable 
landmarks or features for fixing the coordinate S5^tem. 

13. The apparatus of claim 11, fiirther includiog means for performing quahty checks of 
an image taken at one device, to ensure that it has sufficient features and landmarks to 
render it suitable for later comparison and coordinate transformation. 

14. The apparatus of claim 1 1, fijrther including means of calculating and giving a level of 
confidence on the positional measurement taken. 

15. The apparatus of claim 11, fiirther including a means for automatically giving a 
corrective value for the spatial adjustment of the diagnostic measurement taken or 
treatment to be applied. 
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Figure .5 . Embedding of schematic eye in co-ordinate systein 
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